Validating and Improving Test-Case Effectiveness

0 7 4 0 7 4 5 9 / 0 0 / $ 1 0 . 0 0 © 2 0 0 1 I E E E J a n u a r y / F e b r u a r y 2 0 0 1 I E E E S O F T W A R E 81 ultimate system quality. Implementing the function test as a formal process lets testers cope better with the functional complexity of the software application under test. Testplan documents and test-case specifications are important deliverables from the formal test process.2 For complex systems, test cases are critical for effective testing. However, the mere fact that testers use test-case specifications does not guarantee that systems are sufficiently tested. Numerous other factors also determine whether testers have performed well and whether testing was effective. Ultimately, testers can only evaluate complete testing effectiveness when a system is in production. However, if this evaluation finds that a system was insufficiently tested or that the test cases were ineffective, it is too late to benefit the present project. To reduce such a risk, the project team can assess testing effectiveness by performing in-process evaluation of test-case effectiveness. This way, they can identify problems and correct the testing process before releasing the system. This article describes a technique for inprocess validation and improvement of testcase effectiveness. It is based on a new metric and an associated improvement framework. These work together to improve system quality before its release into production.